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Section 1 



What is Computer-Assisted Instfruction? 



Computer-assisted instruction (CAI) is a process of individualizing 
instruction, that is, a set of procedures in which the computer is employed 
to control the selection, sequeWin^ and ev^uation of learning materials. 
In this rffanner CAI not only facilitates the instructor's work but also 
enables ^ve)ry student to have th^ equivalent of private; indivi'dualized in- 
struction. CAI ha^ the potential to: a. accelerate learning process, b. 
augment conventional teaching methods, c. to serve experimentally in develop-- 
ing educational courses, d. nrovide remedial teaching measures, and e, assist 
in achieving consistently higher teaching standards', , 
* ♦ ( * 

In achieving these objectives, a CAI system depends on the ability 
of the computer to' provide two significant capabilities: 

1. Memory . The computer provides a detailed 
record of students' responses to indi- 
vidualized^ displays of instructional ma- 
^ ter^-als in a form directly useful for 

automatic processing. For example, the 
computer can gather, store, and process 
information about individual students and 
their choices, performances, and route 
through instructional materia].. 

r 

'i^ '^2. Logic , The computer has the capability 

to make the organization of instructional . • 

information dependent upon characteristics 
of the individual,^ If is versatile in that 
it can be programmed to be Responsive, i.e,,- . * 
, to l9dapt-and modify the teaching logic in 
' I ' response to student perfo'rmance and back- 

' ^ ' ground. 

Thus, it appears that there are some things wbich CAI is able to 
do better than any other ^edia: 

1. secu^^ store and process information about the 
students' performance prior to /end/or during 
instruction to determine subsequent ac tivities 
•'in the learning situation.' ' 

*^ 2, store targe amounts of information and make it 

available to the learner more rapidly than any 
other- medi^a. , 

3, provide prdgramm^d control of several media ^such ^ 
as films, slides, TV, and demonstration equipment. 



A. Kivc the author or teacher an extreme ty' con- 
, ^ venient technique [or designing and developing 
• ' a course of ins^truction. 

5. provide a dynamic interaction between student 
and an instructional program not possible with 
most other media . 

The basic .principle of CAI that each student can learn according 
'to his own particular requirements: This not only means that each student 
can learn as quickly as possible, but also that the'amount and content of 
material presented can be tailored to his individual needs. Using this 
system, students who are able to grasp and retain subject matter with a 
minimum amount o'f explanation and drill can advance to n^w material in 
accordance with their ability. Slower student^ can be directed to 'alternate 
presentations, drill, and exercises that alTow them.xo learn at a slower 
pace. 

• 

, The IBM 1500 Instructional System is a versatile tool for computer- 
as'sisted instruction. As many as 32 students, each working independently 
on a different problem, can share the system at any one time. Textual 
material, black-and-white or full-color pictures, and audio messages can 
be presented to students a individual instructional stations. The course 
author can specify which material is to be presented as a result of 
analysis made by the computer during instruction. For example, a course 
author can direct that a student skip an jentire section if his responses t^o 
early questions indicate that he already knows the material in that section^ 
He can also direct a slower student to a^ remedial section of instruction 
if his responses indicate a weakness in a particular area. All analysis 
and transferring to sections is performed automatically by CAI application 
programs associated with^the operating system, which controls all computer 
activity and all interaction between students and course material during 
instruction. The operating system receives its directions from information 
the author has provided it through d special education-oriented language 
call Coursewriter II. 

<^ 

In a veil -prepared program tlie s^tudent progresses according to his 
individual capabilities. The mgre. capable studeat moves faster because he 
makes fewer errors or otherwise meets author/teacher-defined performance 
criteria. The slower student requires more practice and in some cases more 
information to achieve an acceptable l^vel of understandirvg. It is the 
course author's responsibility to plan his presentation so that each student 
is directed through the course material that best suits his learning pattern. 
Coursewriter programs are made up of instructions that specify what course 
material is to be given and control the sequence or its presentation to 
individual students. 

1. present textual material on the typewriter or 
display screen. 
^ 2 , ask questions . " * ' 

3. . process student responses 

4. operate the audio and image projector units. ' 

5. perform arithmetic and logical operations. 



The most significant part of any computer-assisted instruction 
applicajilon is the design'of the cowrse tnaterial and the method used to 
present it to the student/ Eight general , modes of CAI utilization have 
been identified as having potential for improving student achievement in 
varied types of learning situations, 

} 

1. Drill and practice assumes that students need 
a great deal of practice in order to master 
* certain basic knowledge, procedures, vocabulary, 

nomenclature, or mathematical skills^ Drills to' 
provide this practice can be presented by the 
computer in a fairly standardized fashion and 
the patterns for student-computer interaction axe * 
generally limited to simple correction and retrial. 

Utilizing its extensive memory, its endless patience, 
and its ability to adapt to student performance, 
this mode of computer use has been very effective. 
Instruction can be modified to meet the needs of 
eaQh, student both as to level of difficulty and 
rate of presentation. This potential to Individualize 
instruction is a very strong argument for. developing 
the use of Qkl . 



2. Tutorial programs can utilize a variety of question- 
and-answer sequences, presentation of reading | 
passages, and so f^rth, simulating student-tutor 
interaction. Instructional sequences that use 
remedial^ and skip-ahead pathways selected on the 
' basis of previous Student responses are incorpor- 

/ ' ated extensively by computer programs to move the 

" ' : * student toward the attainment of a per of specifically 
' * defined teaching objectives. The important factor 

here is the kind of responsibility assumed by the 
teacher for the kinds of interactions which occur ^ 
during the instructional experience. \ ^ 

\ ^ ' 3. - Sumulation provides the establishment of an artificial^- 

( but realistic physical, mathematical, or social 

f- environment and is responsive to decisions made by ;^ 

/' . the student as he receives information at the - : 

/ • - terminal. The inter.-^ntion and feedback information 

' * prbvided by the constantly changing configuration 

- * • ' of the system enables the student to learn how to 

imodify his responses to achieve a desired objective. 
In mojst instances, prior knowledge of skills and 
concepts is assumed so that the stodent can deal 
with more complex "environment** created by the 
x:omputer. The laboratory sequences would fall' into 
this catagory. 

, To implement this mode of CAI the teacher must define . 
^ ' ^ the model- sufficiently to. permit i't to be* 

' ."^ • programmed. A computer program must be written to 



process the student's input so that he gets^ 
a meaningful output* The, output is determined 
by what the student does" and )Dy the program. 
' The student interacts by using natural language* 

4, The inquiry mode is the fourth type of CAT 
application* In this mode .the CAT system re- 

^ spdnds to the student inquijry with answers 
it has stored in its' files to the extent that 
the algorithms it contains provide access to 
that information. In this mode, the in- 
-structional staff must learn how the system 
operates in-order to establish files* an<b 
search algorithms that anticipate student 
questions. 

5. Gaming simulation is less akin to .a real life 
situation*, The student can play actual problem- 
oriented games which enable him to make 
decisions about complicated set situations. 
Alternative choices are limited to tne relation- 
ships that the computer's programmed^ to describe, 

.6. Problem-solving applicajtjons re<|«lre that the 
student learn> a Igorithmic or algebraic computer 
languages to use the cdn^uter's information^ file 
to retrieve and disgJLay;^xiSta. This is a resoui^ce 
that: permits* the student^to use the computer as 
a problem-solving and ^>i^lora.tory tool. In some 
instances' a mathematical, language may be used, 

7. Cohiputer-Aided Laboratories . The computer can be 
used at least three way^s' in the laboratory. 

First, it can be^ used principally' as a guide to 
present the student wit^ problems ^hat-he solves 
at the laboratory beficltTand then types into the - 
^ Jtermitial for verification. At this point; he is 
branced to one of a variety of subsequent opera- 
tions depending upon th^ adequacy of his responses. 

* /v 

8. Testing,' Recording and l^ocessing Student Performance . 

* * * * / 

As indicated previously^! tHfe potential. of CAl/to 
undertake the assessmeud^ of student performances 
- is 'a -key element in individualizing instruct/ 
. The computer cah\be of" Considerable assistance to 
the teacher in keeping Jccurate and coftiprehrensive 
records on individual* ^sjudent performance ,/ regard- 
less of the method of ijistruction used. The assess- 
ment of student performance also includes^ testing 
of a formal natOre as wfll as collecting data on 
daily performance. Again the computer yean be used 
for this activity, The'Jtesting can be/quite 
sophisticated and results ma.de known /o th^ student 
immediately. • -3 , 



By comparing response types, errors, and other 
performance' data with detailed instructional guide-^ 
^ lines established by the course author, the computer 

.is able to tailor subsequent material to the 
capability of the student. -In fact, the analysis of 
performance data may suggest ways in which the 
instructor might enrich his course material or reveal* 

^students for whom specialized help appears desirqblef 

At; the Computer Assisted Instruction Laboratory, Callege of Education 
T^ie Pennsylvania State University, the IBM 1500 CAI system is in use. With 
this system it *is possible to develop and present college l^vel courses ^hat 

1. Present macerial through the most appropriate 
medium^ i . eNw^display screen, image projector, 

or audio unicL v - , ^ * 

2. Receive student responses t)f varying types and ^ 
r 'lengths-'-from one character to phrases and 

' ■ sentences . - 

3. Include <juestions of^varying degrees of complexity. 

»4. Present remedial material to students whose responses 
' show weakness in specific areas. 

5, Present additional advanced material to students 
witli exceptional le^arning abilities. 

6.. Present drill exercises^ to'1:einfor/ce material 
learned in §arlier sessions. 

7,^ Eva-luate each' student ' s response immediately after 
he enters it«ajid change the sequence of presentation 
BS a-resujLt of this evaluation. i... > 

i 

- 8. Keep student motivation at a hi^h level by keeping 
each student informed of his 'progress . 

9, E^isure that ^ each student moves ahead only when ' • / 
his respbnses indicate that hd has an adequate 
grasp of the^material which has already been presented, 

10.' -test the student's progress at appropriate poi/its 
in the iessop. ' ' " 
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Section II 



of Instructignal Research on CAJ*- * * 

^' ^ ^ ' A'. Comparative Studies , ^ 

Axeen (1967) developed an4 evaluated a program on', how to use the 
libi^ry employing the PLATO system.' She concluded that, iise of the library 
couW be taught with CAI fAI and conventiohal classroqm students both 
ma^e significant gains, but the difference between groups' w^s not significant. 
Students learned faster on-CAI'; PLATO lessons took much more time to prepare 
than lectures; and ' subsequent use. of' PLATO instruction saved time as compared 
with conventional instruction. , ' . ' ' ■ " ' 

, Ash and Mol'ler (1967) progrararfied a unit of material on terminology 
and concepts in modern mathematics an^ administered it to 16 college sophomore 
Ss on CAI in approximately two 45-minute .sessions while 16 5s received live 
classroom instruction on the same material. While the CAI Ss "had a higher 
mean on the pos^ text .(15 vs 23) than the controls, Che difference was not 
significant. Attitu^i'nal evaluation should 30 percertt of the CAI Ss 
favored CAI over tradtional teaching, 27 percent were rteutral, and 43 'percent 
favored traditional lectures and discussions. - • 

« » 

^ ^ ' Bitzer (1966) studied, the use of PLATO for instruction in clinical 
aspects of medical-surgical nurs.ing. Seven freshmaq in nursing were taught 
with a CAI inquiry .program whiJLe sevel recel^ved live clinical instruction. - • 
The mean Post-test score for the CAI Ss was '?6, for the control group, 23, 
and thedifferencp was significant at the .09-level. Student attitudinal ' 
evaluation r^ve^led that the following were perceived advantages of CAI: 
(1) active participateion, T2) individual .rates of progress, (3) immediate 
feedback, and (4) simulation of work with patients. ' 



^Adapted with few changes frbm^ John Feldhusen and Michael Szabo, . 
, "The Advent of tKe Educational Heart Transplant, Computer-Assisted In- * 
struction: A Brief Review of Research;" Contemporary Education . 1969, AO ' 

Axeen, Marina E. Teaching the use of the -library to undergraduates; 
An, experimental comparison of computer-assisted instruction and the con- 
ventional lecture method. A teichnica 1 ^report , Coordinated Science Laboratory, 
University of Illj,nois, Report R-361, 1967. : 

Ash, W. and MoUejr, Nancy ' Learning modern mathematics--convention/3L ' 
> vs computer-assisted instruction. A technical'report. Educational Psychology, 
I Section, Purdue University^ 1967 (mimeo) . ^ 

J 

Bitzer, Maryann. Clinical nursing ins^truction via the PLATO simulated 
laboratory. Nursing Research, 1966, 15, 1-7. - \ , 



S-^urcfak (1967) studied the effects of a CAI program, a pro- 
grammed .ext, and a conventiohai textboofc-workbook combination in 
teaching Fortran programming to 48 college students, 16 per treatment. 
The CAI group scored significantly higher than the other two groups, 
» ^^^^^ 

Schwartz, and Haskell (L966) ufjed a CAi program for training 
electronic technicians in basic data-processing, A standard pro- 
grammed instruction unit^ (PI) for the same purpose was already in use. 
The PI unit was used with 79 Ss -and the CAI with 25 Ss. Post-test * ' 
means did not differ between groups. It took 22 hovrs for the CAI 
group to complete the instruction. This was significantly less time 
than it took students who received the programmed unit (25 hours). ^ 
Both grobps saw the-method PI or CAI as about equal, to regular classroom 
instruction for lea^rning and interest. < 

.Schwartz and Long (19^7) compared a self-study program on intro- 
duction^ to computeres with .a CAI program on the same^ subject . /porty 
IBM fi^ld engineers served as Ss, 16 on self-study and 24 on dAI. The 
difference between the mean ferformances pf the two groups on the post 
test was judged to be on no practical significance, but CAI Ss took' 
significantly .less time in the training as a whole. All students in 
both groups had been exposed to CAI, and overall they indicated a pre- 
ference for CAI over -self-study. 

J* » 

O'Neal (1968) summari-zed IBM's Field Engineering 6aI applicatiohs 
Research during 1967. Six training areas were studied and eleven separate 
p-rojects were run evaluating post test performance, time to complete, and 
attitudes. Significant differences were found in favor of cAl in time 
to complete three of the, courses and in attitudes toward two of the courses' 



. Schurdak,,J. J. An apprpach to the use of computers in the in- 
structional process and ah evaluation. American Educational Research 
Journal , 1967, 4^. 59-73> ' ' 

\ ; Schwartz, H. A., and Haskell, R.' J. A Study of computer-assisted 
instruction in industrial training. Journal of Applied Psychology . 1966,' 

' .\ • '■ • ' ' ' ■ 

Sc4iwartz, H.vA. and Long, H. S. A Study of remote industrial training 
via^computex-assisted instruction. Journal of Ag^Ued Psychology . 1967, 5l', 

',';■* . • • '.' * ' 

. ',OlNeal,'L. 1^. CAI applicafioas research in IBM field Engineering 
education. A technical report from IBM^s Systems' Development- Division 
Poughkeepsie, New York,. 1968. ' > • 



FelJhusen and Chavers (1968) reported' results on th§ use of CAl' 
to teach graduate students in teacher education the flanders plasgroom 
interaction analysis system. Th^rogram wa^ in tutorial form written 
in Coursewriter language and ^'took two to three 'hours per student. SUdea 
j^ere used in addition to keyboard input and output. CAI students* . 
achievement was not significantly higher than self-study students who 
♦studied a specially prepared nianual. However, CAI students and students 
who used the self-study manual scored significantly higher than controls 
who received no instruction. 

^ Adams, Morr^* son and Reddy (1967) described a CAI language labora- 
tory designed to teach spealcing, understanding, reading and writing in 
a first year college German course. Preliminary evaluations provided 
no data on student achievement but indicated that the program was 
regarded by the instructor and students'as successful funotiona lly . >In 
a later report by Morrison and Adams (1967), evaluative data was reported 
which indicated that .students in the CAI German program, when compared 
with a class taught by a live instructor who used the audio- lingua 1 'me thod 
and a language lab, scored higher on a writing achievement test at the 
end of the first semester, but there were no significant differences 
between groups at the end of the second' semester on tests of speaking, 
listening, and reading. 

Fil^p-and Murphy (1967) described the development and ^evaluation 
pf a computer-assisted learning- (CAL) system for in-service education of 
high school biology teachers. -Teachers used the terminals before and', 
after the normal sdhool day and weekends. CAL teachers (N=23) were com- 
pared with an uninsfructed control group of 11 t»eachers. The CAL grpup 
^outscored the controls on three achievement tests, and it was concluded 
that the attitude of the CAL ^group toward the innovation was favorable. 



Feldhusen,^ J. F. and Chavers, Elaine. Evaluation of a qAI program 
to teach the Flanders In'teraction .Ana lys i^ system. A technical report, 
EHucational Psychology Section, Purdue University, 1968 (mimeo). . ^ 

Adams, E. N. , Morrison, H. W. and Reddy, J. M. Co^Jversation with 
a computer as a technique of language instruction. IBM Research Paper, 
RC-1815,.IBM Watson Research Center, Yorktown Heights, New York, 1967. 

*■ 

^ Morrison,- H. W. and- Adams, E. N. Pilot study of a CAI laboratory 
in German. IBM Research Paper, RC-19.74, IBM Watson Research Center, ' 
Yorktown Heights, New York, 1967. 

• ' '* 

Filep, R. T. and Murphy, D. B. Computer-assisted learning for in- 
service teacher education. Technica^l Memorandum--(L)--3494, Systems 
Development Corporation, Santa Monica, Califoi^nia, 1967t' 



Grubb and Se^fridge (1962) reported a pioneering fesearch on ^he 
use of GAI in teaching psychological statistics. Six students received ' 
•CAI, eight received lectures, and eight prograimned text. The CAI group 
took 5.3 "hours, the lecture groug 49 hours, and the programmed text 
group 12.2 hours. Comparative achie.vement data was available only for- ' 
the CAI and lecture groups. The results indicated thaJt th§ CAI group 
outperformed the lecture group. ^ - . \ 

Johnson and Borman (1967) evaluated three typ^s of stimulus pre- 
sentations ii:iCAI:^(a) typewritten, (b) audio, and (c*) booklet. Ninety 
Ss were involved in the study; the number of Ss in each of the treatments, 
^groups (three experimental and ^one control) were unequal. The instructi<5n 
consisted of about one hour of material^on 'physics . All three experimental 
groups scored significantly higher on the posttest than did the control 
group, but there were no significant differences among the three experi- 
mental^ methods . , * ^ ' ^ 

B.' Individual Di f f erences ,(ID), and CAI 

Mitz.el (1967) presented a final report on the development and evalu- 
ation of four college courses developed for CAI. Evaluations were run 
for high and low ability students. The courses included audiology, 
accounting, economics, and modern mathematics. Comparisons of CAI with 
control group achievement were made for'only two of the courses, and these' 
results revealed no significant differences. ^However, the high aptitude 
subjects had significantly higher post test scores fewer program errors, 
took Ifess time on the programs, and developed more favorable attitudes ; 
'toward CAI than low aptitude; subject^ . . * " / \ 

♦ .•,(9 *♦ V 

Grubb, R.>E. and Sel*€ridge, L. D. The computer tutoring of statistics: 
A preliminary report. IBM Resear'ch Report, RC-724, Thomas J. Watson Research 
Center, Yorktbwn Heights, New York, 1962. 

Johnson, -W. and Borman, K. G. Relative effectiveness of various 
modes of stimulus presentation through computer-assisted instruction. 
In H. E. Mitzel and G . L. Brandon ; (Eds . y Experimentfatipn with/computer- 
assisted instruction in techni^cal education. Project Report No. 5-58-074, 
Pennsylvania State bniuersity, 1967, 27-40. ' 

• ♦ 

Mitzel, K. E. The development and presentation of four college 
courses by cdmpdter teleprocessings Final technical report of OE 
contract No. 4-16-010^ Pennsylvania State University, University Park, 
1967. ' ' . ' • ^ - • ' 



^ , Brown and Bahn (ISeS) ^studied the eff^ts .o£ picdor knowle^ige of 

the subject matter on learning from programs on modern mathematics 
which did 6r did not make provision for pro-existing 'individua 1 differences, 
There were 32 an^l 33 Ss in the two treatments respec timely • S»s*7"level 
of prior knowledge was^ measured. , Ss with prior knowl^^ge of the subject 
scored significantly higher on the post and retention i^st^s than those 
with n,o prior knowledge in the treatment which provided specific pro- 

''''Vi"s4^n for tiffese IDs. Ss who had ledge tool^ significantly 

less)tijne in the program in the t^^^HilH|Eaich provi^^d for IDs than 
•in the treatment which did not.* ^fKfr 

Oilman and Gar^ula (1967) in the study on modes of feedback, .found 
that low ability Ss took more time to* do the program than high ability Ss* 

Silberman, et. al. (1960) foOncT^hat student aptitude was sig- 
nificantly and pos'-iv^ly correlated with p'ost test scores in both linear 
and branching prograi.i?: and n^^^atively correlated with time to do the 
program and number o ^rror*' ' • both methods. 

la the study by Coulson, 'et. al. (1962), ^ which significant 
differences were found favoring the branching group on the post test, 
correlations between c^titude and post test scores were not significant 
in either the linear or' the branching group. 

In the previously cited study by WodttW, et. al. (1962), in which 
ngnifi'cant differences were found favoring the branching group oh the 
post test, correlations between aptitude and post test scores were not 
significant in either the linear^ or the branching group. 



Brown, B.< R. and Bahn, T. A ^ Prior knowledge and individualized 
instruction. In H.B. Mitzel and G.L. Brandon (Eds. )* Experimentation with 
$:omputer-assis ted instruction in technical education. Project Report 
No. S-Si-OyA, Pennsylvania State University, 1968, 1-15. 

Oilman, D. A. and Gargula, Clara. Remedial and Review Branching 
in computer-assisted -instruction. In H.E. Mitzel and G.L. Brandon (Eds.) 
Ei^erimentatioji with computer assisted instruction in technical edcltation. 
Project Report No. 5-85-074, Pennsylvania State University, 1967, 49-55. 

Silberman, H. G., Coulson, J. E., Melaragno,* R. I. and Eastavan, D* P. 
Fixed sequence vs. branching in computer-based teaching maChiae. Systems 
Development Corporation,/ Sp-195, 1960. 

Coulson,* J. E., Estavan, D. P., Melaragno, R. J., a^id Silberman, .H. G. 
Effects of branching in a computer controlled auto-instructional device. . 
Journal of Applied Psychology , 1962, 46^ 389-92. ^ . • • 

Wodtke, K. Up Brown, B. R., ^ahas, H. R. , and FrederifC^f^ ^^;tri'cia.^ ' 
The effects of^^bj^ct matter arid indivi<lual differences on fecotoWy from* 
.scrambled nos. 'or^jelrefl instructional programs, a paper given at the American 
-Educational Research Association annual-meetiftg, 196B." ^* 



•/ O'Neil, Spielberger and Hansen (1968) used a CAJ- program on .complex 
numbers and compounc? fractions which could be completed in one sitting 
with undergraduate Ss who were given an- anxiety-indiTcing message when they ^ 
arrived,. The program was divided into a hard and an easy part. 'They 
found tj;iat Ss responded to difficult CAI materials with an increase in 
sel £-report=ed anxiety and physiologically measured anxiety, (blood pressure) 
and that high-anxiety Ss made more errors in the difficult portion of 
the ^program than low-anxiety Ss while Iqw-anxiety Ss made ipore errors on 
the easy part. 



Wodtke 



(1965) at The 
on the effect 



Mitzel and Brocm (1965) found that low achievers found in- 



struction on a rembte CAI terminal to be too rapid.. 

The moilt extensive CAI tutorial experimehts were performed by Wodtke 



Pennsylvania Stat€ Universityv The first experiment focused 
of scrambling the implicit se.qiience of a set of mathematical 
concepts, *Rafidomizing the sequence of the material Led the college students 
to -make more errors in working through the program and to require more in- 
structional time to complete the courses This increase in latencies on 
individxxal questions led to a decrease in efficiency of instruction as 
indicated by^ the amount learned per uriit time. The scrambling of the 
material interfered most with the learning of the high-aptitude stud-ents* 
This negative effect on the high-aptitude students was also expressed 
in the students' self-reports on an anxiety scale, Iri a second s.tudy 
Wodtke (1965) also had college students work via CAI through ^ modern 
mathematics program and found significant correlations between general 
j ntel»ligence and other aptitude measures with their performance on the 
CAI course material. This finding is the reverse of that found In many . 
programmed 'instruction experiments. Attitude measures about CAI, 
although positive, did nht vary significantly with any of the CAI achieve- 
ment outcomes. This series of studies at The Pennsylvania State University 
indicates the uses* CAI couse materials can have as media by which to in- 
vestigate instructional variables* ^ 



d'^eil,'H. F,, Spielberger, C, D, and Hansen, D, N, State anxiety 
and tagk Ci.fficulty using CAI media, A paper given at the American 
Educational Research Association annual meeting, 1968, 

Wodtke', K, H,, Mitzel, H, E., and Brown, B, K» Some preliminary 
results on the reactions of students to computer-assisted instruction* 
A paper given at the American Psychological Association annual meeting, 
1965* • • 

V7odtke,^K, H, "Preliminary Research Findings", Experimentation 
with Computer-Assisted Instruction in Technical Education.^ (Edited 
by Harold E, Mitzel and George L, Brandon,) University Park': Computer 
Assisted, Instruction Laboratory, Pennsylvania State University, 1965, 
25-41* 



^ Stolurow and Qavi^ (1965) reviewed studies of the interactidn of ID 
variables with" method of Instruction and concluded that such interactions 
do/in -fact, occur in a Variety erf instructional settings and methods. 
They also suggest that CAI will be a\ tremendous aid in conducting research 
on ID-method interactidiis and in implementing instruction which matches 
.student with method. 

^ ^ C. ^ Basic Leaning Studies in CAI 



• Hall, Adams, and Ta"l'dib uono (*196§) studied thfe effects ofr providing 
f^^edback in^tlfB form of the fult correct resport^e when an error -was^made 
or of pointing-'out' matching letters of the alphabet between the correct 
answer anH th^t given by. the student , Undergraduate Ss learned states and 
capital ^pities. The grpup who j^eceived ^full resf>onse feedback fook signi- 
ficantly less time to c^nplete the program, but the amount learned did 
not differ significantl^'between .groLpS. ^ ^ 



•Gilman, (1968a, L968b) studie'-^ kh,e effects of five types* of feedback 



in a multiple-choice response mode C 
of results or raferely say^Ljng "correct" 
iicatioTi of fhe letter erf tjie correct 
answer, and (E) B, p, and D combined, 
were instri^cted witb a (JAI program />n 
stratified with a mental- ability measu: 
significantly more cettainty aijout the 



program: -(A") no feedback, (B) knowledge 
)r "wrong" to the student (C) identi- 
raswer, (D) e^planation'of correct 
There were 15 Ss in each group who 
[eneral science concepts. Ss were 
lie, Ss in groups D and E experienced 
;orrectness of their responses prior 



t^ feedback than Ss in A and^B,,Ss in groups C, D, and E earned signiiicantlt 
higher post test scores .'than Ss in A anolB, but there were nb differences 
among groups^,,in attitude toward' the methods of instruction. 



Stolurow, L, M, ^nd Davis, D, Teach^g machines and computer-based 
systems* In R. Glaser fEd.) Teaching machines and programmed. learning II > 
Data and Direction's , Washington, D. C: department of Audio-Visual , 
Instruction" of the National Education Association, 1965, 162-212. 

Hall, K. A., Ad'ams, , and Tardi*buono\ J. Gradient--and full-response 
feedback in computer-assisted instruction. The Journal of Education^ Research 
1968, 6_1, 195-199. " ' ■ • * 

Oilman, D. ^» A comparison of several feedback modes in a computer- ♦ 
assisted adjunct auto-Instructional program. School of ^ucation, Indiana 
State University, Terre Haute, Indiana, 1968a (mimeo) . 



Oilman, D. A. The. effect of feedback on learner's certainty of response 
and attitude toward instruction in a computer-assisted instruction program 
for teaching concepts. School of Education, Indiana State Univetsitsy, Terre 
Haute, Indiana, 1968b^i^meo) . - , • ^ 



• Silberman/ Coulson, Melaragno and Estavan (1960) studied the effects 
of branching and fixed-sequence instruction in a CAI program on Irogic. 
Thirty-six college s/tudents served as Ss. Branching students received a 
sequence determined by their errors. Fixed sequence Ss were paired b^ 
ability 'level with branching Ss and each number 2 member of the pbir then 
received program In the sequence order pf his branching mate. The 
differ.ence between groups on the criterion test of achievement was not 
significant^ ' 

Vodtke, Brown, Sands, and Fredericks (1968) used undergraduate Ss 
anH CAI programs' on modern mathematics and speech pathology to investigate 
the effects of logical and scrambled frame sequence in CAI. The modern 
mathematics progranv was judged to be conceptually structured and therefore 
Judged- to require a logical frame order while the speech program consisted 
of discrete concepts which would not be as dependent on logical sequence. 
There w^re no significant post test differences between the logical-order 
and scrambled sequence groups in either sub ject 'matter , but the logical- 
order group^pei;iormed significantly! better on the modern mathematics 
program (structured)^h^n did the scrambled group in terms of errors and 
time on ,the program. 

Gilmari and Gargula (1967) studied the effects of linear and branching 
sequences in a physics program on dimensions analysis. The branching program 
included remedial frames which were used only when Ss made errors., Ss were 
acquits who took slightly over an hour to go through the program and who 
were divided into braching and^ linear treatments. There were no significant 
differences in post test performance between groups, but branching Ss used 
-significantly more frames. ' , ^ 



Silberman, H. G., Coulson, J, E., Melaragno, R. J., -and Estavan, D. P. 
Fixed sequence vs branching in a computer-based teaching machine. Systems 
Deve^lopmeftt Corporation, Sp-195, 1960. 

s " \^odtke, K. H., Brown, B. R., Sands, H. R. , and Fredericks, P. The 
effects of subject matter and individual differences on, learning from 
scrambled vs. ordered instructional pr:ograms. A paper given^at the 
American Educational Research Association annual meeting, 1968. 

^Gilman, D. A. and Gai?gula, C. Remedial and review branching in 
computer-assisted iastructioV. In H. E. Mitzel and G. L. Brandon (Eds.) 
Experiment^ation with computer-assisted instruction in technical education. 
Project report to OE, project no. 5-85-074, The Pennsylvania State 
University, 1967, 49-58. 
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Section III 

Studies Involving Instructional Effectiveness, Time 
and Student Attitudes 



t^is section several statements are made concerning the in- 
structional-effectiveness of computer-assisted instruction, and student 
attitudes towards computer-assisted instruction. Following each state- 
ment is a list of studies which may be interpreted as generally supporting 
the statement. 

#: • ' ' . 

r There are abstracts in the. appendix for those studies listed here 

for which a complete report was. available. Many of these abstracts indicate 
that the studies are weak in terms of experimental design, numbers of 
students participating, anr) the duration of the instructional treatment. 
The criterton for listing other studies here was b^ase^ on available summaries 
of CAI ;research. 

r • • * 

A. Instructional Effectiveness - / 

Since computer-assisted instruction Is a relatively^ new in<struction5l 
technique, the number of well-documented comparative experiments is/ somewhat 
•limited. However, the studies that haVe been made have demonst^atJi either 
superiority or at least the equality of computer-assisted instrWJo'n when ' 
' compared to conventional methods. 

^h, W/anc^ Holier, Nancy "Teaching. Modern Ma thematics--Cojn- 
ventional vs. Computer-Assisted instruction," A technical report^ 
Educational Psychology Section, Purdue University, 1967 (mimeo) , 

Feldhusen, J. F. and Chavers, Elaine "Evaluation of a CAl/ Program 
to Teach the FLandiis Interaction Analysis System." A technical report. 
Educational Psychology Section, Purdue University, 1968 (mimeo) 

Grubb, R. E. and Selfridge, L. D. "The /Computer Tutoringlof 
Statistics: A Preliminary Report? IBM ^esearcPuReport, RC-724, "jhomas 
J. Watson Research Center, Yorktown Heights, Ne^|^ York, 1962. 

Hansen, Duncan N.; Dick, Walter; Lippert, Henry T., et. al. "Research 
and Implementation of Collegiate Instruction of Physics Via Computer Assisted 
Instruction," Computer Assisted Instruction Center, Flor;ida Statie University, 
Tallahassee, Florida, Volume I, Technical Report No, 3, November,] 1968, 

Hansen, D, N, "Learning Outcomes of a Computer Based Multilnedia 
Introduction-Physics Course," *Seminannual Progress Report (Flprida State 
University, Tallahas3ee, Florida, 1967). 

• Keats., ^'Definitions ari^ Examples of Feedback in a CAI Stimblus 
Centered Program." Paper given at the American EHucational Research 
Association annual meeting,, 1968. " % 
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Majer, Kenneth S., Ph.D., "A Study of Computer Assisted Multi-Media , 
Instruction Augmented" by Recitation Sessions,^' Technical Report No. 1* 
(The Florida State University, TaUahas^ee, 'Florida. CAI Center ; (1969). 

Mitzel, Harold E., et. al., "The Development and Evaluation of a 
Teleprocessed Computer-Assisted Instruction Course in the Recognition of 
Maldrial Parasites." The Pennsylvania St^te University, University Park 
Pennsylvania; Final Report No. R^17, June, 1968. * ' ' 

Moss, Carl^R. and Gilman, David A.. ^Engineering Economics in The . 
Development anH Presentation of Four College Courses by Computer Tele- 
processing." (By H. E. Mitzel and others). Final Report: University Park, 
Computer Assisted Instructional Laboratory, The Pennsylvania State ^ 
Universi ty , June , 196 7 . . " , ^ 

Regari^ J. J.> "Comput;er-assisted Instruction: Some Facts, and Fancies." 
In K. M. Wientez, P.*. Dubois, and Gaffney, H. (Eds.) Psychc^ogical Research 
in Classroom Learning. Proceedings of a' conference at Washi^ton Unive^rsity^ 
St. Louis, Technical Report No. 13, 1967, p8-52. 

Schurdak, John J. "An Approach to the Use of Computers in the In- 
structional Process and An Evaluation." Fairfield University. 

Schwartz, H. A. and HaskeU, R. J. Jr., "A Study of Computer-assisted 
Instruction in Industrial Training." IBM Coporation, Poughkeepsie, Jojurnal 
of Anplied Psychology. 1966, Vol. 50, No. 5, 360-363.. 

B. \\me ' 

One'Of the most consistent findings with computer-assisted instruction 
is the marked savings in instructional time along with no less in post-in- 
structional achievement test performance. 

^ Braunfeld, Peter G. , "Problem and Prospects of Teaching with a Computer 
Journal of Educational Psychology, 1964, Vol. 55, No. 4, pp. 201-211. 

Hall, Keith A., Adams, Marilyn, and Xardibunono, John. "Gradient- 
and Full-Response Feedback In Computer-Assisted Instruction." The Journal 
Journal of Educational Research , V.ol. 61, No. 5, January 1968. 

Gilman, D. A. "Feedback, Prompting, and Overt Correction Procedures 
in Nonbranching Computer Assisted Instruction Programs." Experimentation 
wi th Computer-Assisted Instruction in Technical Education. (By H. E. Mitzel 
an^ others.) Semi-Annual Progress Report. University Park: Computer 
Assisted Instruction Laboratory, The Pennsylvanifil State University, June, 
1966. 

Hansen, D. N. "Computer-Assisted Instruction." Review ^ of ^ducational 
Research , 36 :588-603, . 1966 . / 
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Schwartz, H\ A. and Haskell, R. J., Jr. "A Study of Computer-Assisted ' 
Instruction in Industrial Training." Journal of Applied Psychology . 1966, 
50, 360-363. * * 

Smith, Aurthella. Report on the Evaluation of Mathematical Preskills. 
The University of Texas- at Ai^^in. Science Research Associates^ Inc., 1968. 

\ ^ ' 

Wing, R. L. "Two Computer-based Economics Games for Sixth Graders." 

The American Behaviorial Scientist,' November, 1966, 31-35. 

Wodtke, K. H. and Gilman, D. A. "Some Comments on the Efficiency of 
rhe Typewriter Interface in Computer-Assisted Instruction at the High School 
and College LevelsV Experimentation with Computer-Assisted Instruction in 
Technical Education. Semi-Annual Progress Report. (By H. E. Mitzel and 
others.) University Park: Computer Assisted Instruction Laboratory, The 
Pennsylvania State University, June, 1966. • ^ 

Wof^tke, K. H.J Gilj5ian, 0. a! and Logan T. "Supplementary Data on 
the Deficits in Instructional Time Resulting from the Typewriter Interface." 
Experimentation with Computer-Assisted Instruction in. Technical Education. 
Semi-Annual Progress Report. (By H. E. Mitzel anH others) University Park: 
Computer Assisted Instruction Laboratory, The Pennsylvania State University, 
June, '1966, ' ' 

C. Student Attitudes 

■ * 

Many studies indicate that stuHer^t^ express a fa,vorable attitude \oward8 
compuXer-assisted instruction. ^ 

r 

A^ams, E. N., Morrison, H. W.; anH Reddy, J. M. "Conversation with a 
Computer as a Technique of Language Instruction." IBM Research Paper, 
RC-iSlS, IBM Watson Research Center, Yorktown Heights , New York, 1967. 

\ Borman, Karl G. "Expressed Student Opinion Towarc' Comouter-Assisted 
Instruction. In Tnservice Mathematics Education for Elementary School^^ 
leachers Via Computer-Assisted Instruction. Interim Report, (By K. A. '^liS 
and others). University Park: Computer Assisted Instruction Laboratory, The 
PennSyl 'ania State University, November, 1969. ' 

Filep, R. 1. anJ Murphy, D. B. "Computer-Assistjed' Learning for Inservice 
Teacher Education." Technical Memorandum- (L) -3494 , Systems Development Cor- 
poration, Santa Monica, California, 1967. 

Hansen, Ouncan N. , et. a'l. "The Developme*nt and Testing of a Computer- 
Assfstfd Instructional Unit Designed ^to leach Deductive Reasoning. Quarterly 
.Progress Report, July 1, 1966 through September 30, '1966. Computer Assiste^^ 
Instruction Center, Florida State University, Tallahassee, Florida, pp* 6-10. 

Mitzel, Harold E. and Wodtke, Kenneth H, et. al, "The Development and , 
Pre$entatfon of Four Different College Courses by Computer Teleprocessing." 
University Park: Computer Assisted Instruction Laboratory , The Pennsylvania 
State University, ^Interim Report , June, 1965. 
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'Morrison, H. W. ^nd Adams, £• N. "Pilot <Study of a CAI Laboratory in 
German." Modern Langua&e Journal, 52:5 (May, 1968). ; 

Schwartz, H. A. and Long,, H. A. "A Study.pf Remote Industrial Training 
Via Computer Assisted Instruction." Journal of^'AppIied Psychology, 1967, 51 » 
11-16. 

«» > 

Wodtke, K. H. ; Mitzel, H. E.; and Brown, B. R. "Some Preliiftinafy Results 
on the. Reactions of Students to Computer-Assisted Instruction.'* Proceedings of 
the 73rd Annual Convention of the American ?SychoJLogica 1 'Assoication, 1965, 
pp. 329^^30. ' • • 

Yens, David p. "The Development and Evaluation of a Computer-Based Pure 
Tone Audiometer drainer." The Pennsylvania State University, University Park, 
Pa,., September, 1969, 

Yens, David P.; Siegentha ler , Bruce M.; Milggie^^:1larold E. "The Development 
an'^ Evaluation of a Computer-Based Pure-Tpne M^ionfe4:e^i;.^ainer . " Paper pre- 
sented at the American Ediicational Research.A'Ssociation Cbhyention in Minneapolis 
on March 3, 1970. The major support for this researph was^^Grant No. OEG-2-7- 
070733-4586 from the Bureau of Education for the Handicapped* U. S. Office of 
Education, Department of Health, Education, arid Welfare. 

Section IV * - 

Summary ^■ 

Following are several impressions summarizing the literature cited in' 
port : 



this report: 



1. Computer-assisted instruction appears to be a viable 
Instructional technique having its ccpabilities thoroughly 
grounded in current learning theory. It has the potential 
for becoming a very Substantia 1 instructional innovation; 
however, it must be emphasized that computer-assisted 
instruction is still in its experimenta 1 .(infancy ) stage 
and a^ long way -from actualizing its inherent capabilities. 

2. The avai*lable evidence indicates that computer-assisted ^• 
instruction can teach as well as live teachers or other 
media, that students can learn in less time, and that 
students respond feyorably to computer-assisted instruction. 

* * 

3. The empirical research reported so far 'concerning the 
instructional effectiveness' of computer-assisted instruction 
{in terms of exp*erimental design, numbers of students " 
participating, and duration of the instructional treat- 
ments) appq:ars to be less than desirable. It may be 

that since computer-a'ssisted instruction systems are 
often being 'developed and perfected at the same time that 
research is being conHuct\ed, adequate time and money may 
not be available for implementing. well-designed exf)erimental 
evaluations . ^ ' ' j 



Section V 
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^App'enciiy. 

The purpose of this section isto provide abstracts of available studies 
des^ned to eva'luate the relative effectiveness of C^I as an instructional 
f^^nnique. Each abstract presents: (a) the subject content taught, (b) Rumber 
an^ description of ^students, (c) length of treatment period, (d) criterion 
instruments used, (e) the problem to be investigated, (f) thfe procedure of the 
study,' and (g) the stated conclusions. Tlais information 'is provided so that 
the validity of the .generafizations'generated hjy these studies and other studies 
cited in Sect4.on III may be piroperly interpreted. - 

' ' ■ / ■ ' - 

Braunfeld, Peter G. "Problems and Prospects of Teaching With a Computer" 
Journal of Educational Psychology ^ 1964, 51,/201-211» 

Subject Content: 

-Subjects : 



Treatment Period: 



Criteria! Measures; 



Computer 'Programmir^g 



On the first 'Hay o 
students chcisen at 



: class nine uodergradua te 
randpm were asked t;o serve ' 
as subjects, '^besc-nine students were to 
atten'^ only the conputer Sessions, skipping 
the corresponding,^ ■ secures . The students 
usually were scheduled to come in pairs. > 
During a session, each student tfccupied-a* 
booth by himself and worked completely 
independently on his companion, while monitors^ 
slaved to the students' TV displays, enabled 
observers to watch the proceedings. At the ^ 
end of a week, the nine 'PLATO students rejoined 
the regular , class . ^ 

Materials corresponding to tne first three 
lectures of a university course were prepared 
for use with PLATO. 

Final exams on the' content material, ' 



Problem: 



(1) Can instruction be presented effectively via 
PLATO? 

(2) I*s there a difference in time required by 
students to complete these respective in- 
struct iona 1 presentations? ^' 



Procedur/: 



The slide material for' the three PLATO lessons 
was written with the active cooperation of the 
instructor of the course, L. 0. Fosdick.* Thus, 
^it was possible to make each PLATO lesson cover 
almost exactly the same material as the corresponding 
lecture. At the end of the leSson, each stuient was 
given a. booklet containing^repro^uctions of all the 
slides of the lesson (the main sequence together 



with all the help sequences'), well as the , . 
corrtc*t a'nswTers to all the questions. This 
was done so- that students could review and 
restuHy the material at their leisure at tiome 
and, also, to discourage -them frbm'^ wasting 
Valuable computer time by: taking exfensive notes 
during a session. 

The pedagogical power of PLATO rests on its 
ability to ask questions, judge answers to 
the3e questions, and take a course of action^ 
on the basis of the student's requests^. 
When new material can be presented in^a 
sequence of "well-prosed" questions, some of 
the material t*he student needs to know does 
not lenH itseTf to such presentation. To 
avoid u^ing PLATO merely to present 'page 
after^pdge of text--a possible, but trivial 
use of the systenj--the students were, sometimes 
given dittoed booklets of textunA material 
to study at home. Thjey'were to. bring these 
booklets with them to the appropriate PLATO 
lessons, which' then became problem sessions in 
which 'the stud*ents were asked to apply what 
they had read in problems posed by the machine. 
(The san^e booklets were also distributed to 
the regular lecture students). At t\te end of a 
lesson, the students were also given a set of 
homework problems. At the beginning of the next 
lesson, they were then required to submit the ^ 
answers to these homework problems to the machine 
The homework answets had to be correct before 
the student could begin the ^new material of the 
lesson, but helpf sequences were available for 
each problem. Thus PLATO can be used for auto- 
matically grading homework,^ helping studetns in 
trouble^ and making a record thereof fg(r the 
instructor. 

The results indicate, that: i 

(1) the nine PLATO students were typical of the 
class as a whole. 

(2) they had learned the material from PLATO 
about as well as the other students in the 
regular class lectures, r - 

(3) coany students can grasp ^^he material much 
more quickly than it is presented in the 
lectures . 
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Subiect Content: 
Subjects: . 



Treatment Period: * 



' 20 

• Grubb, Ralph E. and Lenore D. Sel fudge, "Computer tutoring in Statistics" 
Computers and Automation , 19^^^+, 4, •20-26. 

I - ■ ■ ■ \ -V 

C<illege Level Statistics. ' , *^ 

/ ^ . ^ 

^ix students from the King's College Briarcliff 
^Manor, New York, served as paid subjects in this 
I pilot 'Study, 

The computer program would permit one or two * 
, stydenfs to run simultaneously in t;he same ^r 
different courses. All stucients except two 
were under instruction for an hour or less a 
day ^nd generally finished this course module 
within one calendar week. Two students, however, 
were exposed to the same material und^r conditions 
of massed practice; in one Saturday they accomplished 
all but one-half of the last chapter in the text. 

Comprehensive examinations on the subject content 
The examination was one hour in length, consisted 
largely of problem solving,' and was identical 
with the examination used by the senior investigator 
(author) . - . 

To examine the relative performance and instruction 
time required for six students in computer-controlled 
statistics., ^ * . 



Criterion Tests : 



Problem: 



Procedure : 



The statistics course consisted of a sequence of 
questions, answers, error cues, reading assignments, 
^nH' other information stored in the disk file plus 
a generalized computer program. The latter made 
decisions re,garHing • the student's progress throughout 
the course, , ' ^ 



In, actual practl<:e, the computer selects a question 
or problem from the instructional program of the 
course. Each one may have as many as ten alternative 
answers. These answers may be considered multiple- 
choice responses, or as acceptable forms of con- 
structed responses. Tf the studefnt answers :corr^^ctly, 
He is told so by name, "Right, John", and the next- 
problem oi: reading assignment the close of the 
instructional period. This review was accomplished 
by permitting the student* to use the text in what- 
ever way they wished. The mean review time was 
26 minutes. 

/ 

The me^an performance on the examination administered 
after the review waS 94.3 points of a possible lOb. 

\ 
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InstructionaT 
Mode 



Table 1 

Comparison Of Three Instruqtional Modes ^ 
On Identical Material In Statistics 



Mean Mid-term' No, of 

Instructional Time ' Average Students 



Mean 
Review 
Time 



, Mean 
Gr. Pt. In. 
* (Grade C= 
2.00) 



650 computer 
Lecture , 



Programmed 
text ' 



9.3 hrs 

24 hrs. class 
'25 hrs, homework 



12.2 hrs. 



94.3% 
58.4% 



6 

^ 8 



26 min. . \ 2.68 
5.3 hrs. ^2.14 



.data not available 



Table 1 suimnariies the results" of this study compared with 
two other modes of instruction. In addition to the , author's 
college psychological statistics course taught under con- 
ventional lecture methods*, a group using a programmed textbook 
was also available'for 'study within the IBM Voluntary Education 
Program. D^iary studi^es served as a means for data collection * 
in both instances. - ^ 

A 

The mean test pe^rformance for the computer and lecture groups 
over identical material was 94.-3% ^nd 58.4%, respectively.. 
Bbth groups took the same post test. 

Since the programmed text group took a different mid-term 
exam from the one used in this study, those results are not 
comparable and are not reported here. The, prof essional is 
typed. A similar procedure applies to incorrect responses 
except that remedial help is now offered. It should be 
notes that the student is not merely given th"e.*correct 
answer, but i6 promp^ted to it. Remedial instruction may be 
presented In one of three ways. If the question is presentjed 
in multiple-choice form^ an error cue specific' to the in- 
correct response Is typed and the student tries* again until 
he gets the correct answer. If the question cialls for a 
constructed answer, the student is given a general error 
cue for eaqh of the first two incorrect responses and a 
presentation of the fuil correct solution in case he gives 
a third wrong answer. This is followed by an alternate 
form problem or, with constructed answers, the student may * 
be given a set of .remedial "^estlons which he most answer, 
followed by an alternate f orm the problem.- It should 
be noted that this general -program could be used to teach 
any other appropriately sequenced cotirse. 
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If a student requests help, or .does riot respond within 
/a reasonable, ^ime, the computer may type oiit cues. If 
the cues are exhausted, it will give the full solution 
ajid an alternate pr:oblem. The time limit may also be " 
specified for each problem. College students were each^ 
seated before a teaching^ station in a specially con- 
structed classroom at the IBM Research Center. A total 
of five typewriter teaching stations occupied the rootn. 
The nature of 'th^ course was.,explained, arid instructions 
were given regarding procedures with the computer. Since 
the computer was the .sole source of instructiM^n in the 
course, what^went on in the room afterwards was observed 
* by closed-circuit TV. 

Results:' (l)'The over-aH^ean instruction time for the students 

' - 'to complete this half-semester's work was only 5.33 

hours. 

(2) Students were alsd given the opportunity to review^ 

in preparation for a written comprehensive examination^ 
administered at and technical, backgrounds of this 
group also, make any matcHed group comparisons impossible. 
But we may note -this group's rate of progress through / 
equivalent subject matter: the mean time spent Was 12.2 
hours, which is slightly over twice as long as the 
<c6nq)uter groiipls instruction. The fastest text* student 
* took only 5.5 hours (apparently "reviewing" because of 

his prior statistical background) while the slowest 
student took 17 hours. Additional significant data not 
revealed in Table 1 concerning the programmed text group 
is an alalysis of the enrollment. While 29 people^ 
registered for the course, only twelve completed the 
final exam. The exact cause of the high attrition is not 

^ fully known; however, the complaint of boredom appeared 
with high frequency in the diaries. 

Finally, the college lecture group was exposed to 24 
hours of classroom instruction with an. average of ^25 
hours of homework reported in diaries. 

Hansen, Duncan H.., Walter Dick arjd Henry T. Lippert. Research and 
Implementation of Cd'llegiate Instruction of Physicas Via Computer Assisted 
Instruction. Final Report, Project No. 770071 Grant No. OEG-2-7-000071-2024. 
Computer-Assisted Instruction Center, Florida State University, 1968. 

Subject Content: College Level Physics 

* * _ - - 

Subjects: The university administration requested that all students 

selected for the CAI course be given the opportunity to 
voluntarily elect cto participate. Since the- majority of 
freshman at FSU preregister in the summer for the fall 
"ferra, a pool of 100 students who were both pre-enrolled 
for»Physics 107 and were not participating in other 
fij'eshraan reseaVch projects were selected. These Ss 
wet:e contacted by mail; 67% responded favorably, 6% 
unfavorably, and 27% failed to respond. 

23 ^ 



(a) Thirty of the favorable respondents were ra^^ly. 
selected and notified. Due to course changei^and 

a misunderstanding concerning the one-credit physics 
laboratory course, seven of the Ss dropped from^he 
sample. Since clas^ses had met for two sessions, it • 
was decided not to replace these seven dropouts, . 
although there were numerous volunteers available. 
There is no teason to believe that the sample of 
23- Ss was biased on nonrepresentative of the Ss > 
enrolled in Physics lOZ* 

(b) The comparison group of Ss from the convert ional 
' course .was selected by matching sex' and aptitude 

entrance scores on the Florida Twel^fth jcrade 
Examination of these Ss with those of each CXL 
participant. Within th6se matches,, randomljf 
sampliiig procedures were used to match one, S 
from the conventional course with each CAI S. • 

(c) Another comparison group (N=23) was formed by • 
those students from the conventional course 
who voluntarily participated only in the CAI 
practice exercises. 



Eleven week term. 



F].orida Twelfth Grade Examination, Micl-tenn and Final 
exams in Physics, Brown Scale on Attitudes toward 
Computer-Assisted Instruction* 

The major purpose of this research were to prepare and 
perfect a CAI course in introductory tiollegiate physics 
and to con^are it with the conventional lecture/ 
demonstration course. The comparison of the two modes 
of instruction consisted of (a)' learning effectiveness 
of each, and (b) student's reactions -^o. the two modes qf 
instruction., 

i 

The CAI Ss were allowed to schedule their own time a^ the 
CAI center.' At the center, their progress was directed 
by the computer program. This presentation was via a 
cathode ray tube (CRT,''a television-like screen) with an 
associated .typewriter keyboard. Problems and instructions 
to the student were displayed on the CRT. The S could 
indicate his response to the computer by typing his 
'answer on the keyboard or by touching a light pen to tKe 
appropriate location on the CRT. 



A' t^pip^al lesson in the t:.ourse began with the student 
reporting 'to the computer termi'nal and taking'a short 
quiz based upon His reading assignment-. If the j ^ 
student did not pa^s the quiz, he was instructed to 
reread tfre material and return to take* the quiz agi&in, v. 
If he was, successful, the S was* directed to listen to 
a short lecture on the major topic of the lesson. A 
special cairtridgj^ system provided th^ audio 'lecture 
for the Ss at. their terrainars. The S* was also provided 0, 
witV axx outline which included helpful drawings relevant^ 
to.' the' lecture. After completing the lecture, the ^ 
was jquizzed via the germinal on the aufdo presentation, 
ThW'S was then directed to a singLe concept film loop pr 
a HSSC film,'. The single concepJ> film loop presented ■ 
^demonstrations of some^ of .the major concepts included 
■irf-the. lesson. Out lilies were also available for the film 
jops. If' the S was directed to view ^ PSJSC filpi.' he 
)uld notify a proctor who in 'turn would operate the film 
pJ^ojector. The S then , returned to his terminal to take^, 
a $horf quiz on i:he film. Based upon the lesson content, '~ 
theXs might b^sTlirected to other presentations, on .various 
jne^iprT Ajt th§ completion of tlie entire sequence* of in- ' 
strtfctiph, the S^^a^^glvett his next textbook assignment, 

SpeciaJL midrterm and final examiriation reviews were 
available on another computer system, the, IBM. 1440. Since 
^this system utilized only a typewriter ^terminal, the 
student-computer dialogue was typed. 

Most of .the CAI students avergaged about two lessons per 
visit to the Center; the range was" from one to eleven 
4essons; The only Constraint placed upoa the students^ 
in regard- to^ime was that they had to reach tha halfway 
pMnt in the cours.e by the. time of the mid-term examination 
and complete the course by the date of the final examination, 
Th^ same multiple choice tesEs were given to the CAI an^ 
lecture classes. ' ■ ✓ 

Both the CAI and lecture classes were given the same reading 
'*assi^nment^ in Elementary Physi'cs . 

The CAI comput^ system functioned primarily as a pacing, 
quizzing, interacting, and i;ecordkeeping tool*. The first 
activity the student generally performed at the tenffllnal 
each day was to res'pond to a four to six-item quiz which 
covered the textbook assignment which .was given to the 
student at the end of the previous lesson. At the end 
of ^Ls quiz, the student's score was displayed on the 
screen. If he did not answer the minimum number of 
questions correctly, the computer instructed him to* 
sign off jand come back when he was better prepared ta 
pass the reading quiz. , 

O 
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Results: ^ (a) Th^ mean length of time required for completion of 

the course was 10,9 weeks in the eleven-week term. 
When students are allowed to self-schedule, the 
* course completion outcome tends to contradict the 
common claim that CAI courses will dramatically 
reduce the len^h^ of academic terms. However, 
the mean time required to complete the 29 lessons 
was 23*8 hours of instruction. ^This represents 
a seventeen percent savings in instructional' time. 
Considering the fixed durations of the films and 
audio presentations plus the opportunity for 
.repetition of difficult material, this time savings 
indicates 'a significant savings in Instructional 
time. ' * , 

/b) The learning outcomes as reflected in the final 
grade assignments for the three groups indicate 
a marked superiority for the autonomous CAI 
students as illustrated in Table 1. A correlated 
"t" test on the sum of the mid-term and final 
exam scores indicated that the autonomous CAI 
group was statistically- superior to the other two. 
groups, but the difference between the partial 
CAI and conventional students was liot significant. 
The high proportion of "A" grades in the autonomous 
CAI group represents one of the few instances in 
which the upper half of a score, distribution shifted 
r * under CAI treatment. It is much more frequently. 

found that the lower half of the grade distribution 
is truncated due to a CAI treatment. 



Table 1 

Frequency Distribution of Grades for the Thr'ee Instructional Groups 
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Grades 



Conditions 



B 



Mean Grade 



Total CAI 
Partial CAI- 
Conventional 



11 
6 
4 



6 
, 7 
5 



6. 
10 
13 



0 

0- 

1 



3.22 
2.83 
2.52 
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(c) Tfi^ attitudinal 'responses of the students to the 
Br^own Scale on A t ti tuHes' Toward Com{>uter-Assisted 
Irtstruction indicated a jinoderately positive 
ruction to the course^ A summary of thf 'questionnaire 
findings. indicates that the students (1) vere aware 

the constrained dialogue of the CAI materials, 
(2) tended to guess at times, and (3) had a desire 
for even mor^e individualization. All of. the 
participants considered the CAI course to be pre- 
ferable .to their corresponding conventional -courses. 

, Personal interviews revealed twp especially important • 
reactions. First, all of the CAI participants 
indicated a personal feeling of greater concept 
mastery in comparison with their peers.. For example, 
the participants claimed to be better explainers of 
homework problems in comparison with dormmates who 
ajttenHed the conventional course. The second reaction 
,rBlates to the man-machine interface. issu6. All of 
the participants indicated a. preference for the* 
automated typewriter interaction in comparison with 
tiie CRT-light pen interaction* While many factors 
underlie this unanimous reaction (the flexibility 
^^'*' aft fmeaningf-ulness of thp typewriter-presented review 
, n^^erial, the opportunity to obtain a personal copy 

\^ ok the problem exercises, etc.), this fin ing should' 

be investigated in light of *the higher costs associated ' 
' v^th CRT 'terminal equipment^ 

f , . 

Spring 1 Q68--Fi:eld Test \ " 

Subject Content: College Physics 107 < 

*■ ' « 

Subjects: - Inhere were three-, groups of subjects used jn this study; 

• tfwo control groups and on experimental group. The 
fjirst control group consisted of subjects who attended' 
(' cfonventional P107 lectures for the quarter artd received 
a four-hour examination review on the IBM 1440 system, 
'ihe second control group only attended convetional 
* ^ 1^107 lectures for the quarte*r. The experimental groups 

-^t^oTc the entire P107 course via the multi-medta approach. 
These groups were labeled 1440 review, conventional, 
and CAI Autonomous, respectively. The 1440 review 
^ ' ^roup (N=78) consisted of any subject vfrom the con- . 
Yentional class who volunteered to take th'e PJ07 
examination review on the 1440 system, while the con- 
yentioijal group consisted of th'e remainder of Ss i|i 
the conventional class (N«141). 

ihe CAI autonomous , subjects were selected in the following 
manner: During registration in the spring quarter', ' 1968 
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Students signing up for Physics 107 were offered the 
opportunity to take the CAI P107 course. The first 
-f"arty Volunteers within the pre-set quotes of twenty 
males and twenty /emales were accepted. There is no 
reason to believe that this sample was unrepresentative 
of the regular course population except that they were 
willing to participate in the CAI experiment-. However, 
rough polling by show-of-hands in several classes 
indicated that about 70% of the students taking 
Physics 107 would have been willing to participate. 
Thirty-seven of the original forty studfents selected 
for the study Hid irf fact finish the course. * Of these, 
twenty were female and seventeen were male. 

Eleven week. term. 

Tests on content material (CAI Physics Test)^ Watson- 
Glaser Critical T;raining Test, Logical Reasoning Test, 
Skip Destination Test. The choice of relevant tests to 
measure cognitive and affective factors that might 
be related tosuccess in the physics course was planned 
as the first task for the students in the Spring Quarter 
presentation, of the CAI physics course. The tests were 
selected according to the following criteria: the 
nature of the physics content, (2) uniqueness of the 
CAI presentation, and (3) tests that had proven utility 
in measuring cognitive variables. The selection process 
was by necessity a partially subjective one; and testing 
time limitations eliminated many tests (only two, two- 
hour sessions could be- devoted to testing). Seven testjs 
were selected and administered to the membefirs of the ^ 
CAI* experimental group during the first weelc of the 
Spring Quarter. 

During the winter quarter, 1968, following the completion 
of the first study and preceding the second, a number of 
activities were conducted^ whicli significantly affected 
the Spring version of the CAl physics course.^ First, 
'the entire course was reviewed in light of the subject 
performance data, student attitudes about the course, 
and the logistical problems which had been encountered 
during the fall ^juarter. For exan5>le, many of the 
^students expressed the opinion that the materials used 
in conjunction with the 8mm concept films was not adequate 
to describe the activities depicted in the- films. There- 
fore, all these films were recieved and supporting 
documentation was greatly enhanced. Other less significant 
but necessary changes were, made throughout the course 
materials. 

s 
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^ , ' A second task which^was completed during the winter 

quarter was the selection of a battery of cognitive 
and affective tests which were to'be adraini'stered to 
the students taking th^ Spring CAI physics course. 
. ' The purpose of the extensive testing of the students 

was not only to better understand the entering abilities 
/ 'of the studeats, but aXso to ati:emp,t to understand the 

relationship of prior knowledge and entering aptitudes 
to success in the CAI^ course. It was anticipated that 
correlational and regression analyses woujd be conducted 
using these variables/ These types of analyses were 
utilized in order to indicate the relative contribution 
of entering capabilities and -knowledge as well as the 

'\ - ' learning which actually took j>-lace during the course and 

on the final performance in the course. 

Procedure: The students progressed through the Spring version o^ the 

V CAI physics course much as the Fall students had • Special 

evening sessions during the first few weeks were utilized 
in order to administer the battery of aptituae and per- 
sonality tests to students; a total of four hours of & 
testing was employed. Following a brief introductory\ 
session in which they were oriented to the CAI system, \ 
the students were permitted to schedule their own sessi\?ns 
at the CAI Center, The only restriction which ;^as ^ \^ 
* placed upon these students was that th§y were required to 
' . ^ take their mid-term examination on or before the date upon 
which the conventional classroom received their raid-term* 
N The 3^pe type of regulation was used in relation to the 
\ final examination. In all other respects, t^he students 

\ ' ' essentially set their own pace for their own instruction 
in the CAI physics course. ' v " 

.Results: (1) One of the unique features of CAI physics course was that 

it provided for 'individual self-pacing. To determine 
whether, in fact, students utilized self-pacing, the 
distribution of lessons per session per student was 
calculated. The summarized data are presented in Table 1, 
As can be noted, only 27 percent of the occasions when 
* the students were in the CAI Center did they complete 

only one lesson: 73 percent of the visits resulted in 
the completion of two or more lessons. 



\ 
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Table 1 

Distribution of lessons completed per 
Session for CAI students 



No. of 

Lessons 
Completed 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


Percent 
of Time 


27 


38 


17 


9^ 


5 


0 


1 


2 


» 

I 


0 


1 



(2) In order to detenqine whether the presentation of Physics 
via CAI was an effective learning situation, the per- 
' formance of the CAI autonomous group was compared to the 
performance of two groups of subjects who had not received 
this treatment. These other treatment groups Consisted of: 
(1) those' students attending only the conventional lectures, 
and (2) those students attending the conventional lectures 
plus receiving a four-four hour examination review on the 
1440 system. The mean scores for each of the three groups 
for the mid-term examination, final examination and final 
grade are presented in Table 2. It may be noted that the 

autonomous group performed slightly better than the 
other two treatment groups on the final examinatxoji. The 
'one-way analyses of variance for these data indicated, 
however, that th^re was no significant difference .on 
mid-term, final" exam, or final grade between the three 
treatment groups. , ^ 



Table 2 



Mean Scores of the Three Treatment Groups on the Mid-term 
Examination, Final Examination, and Final Grade Distribution 



Mid-term 



:7 



Final 



Final Grade 



Autonomous CAI 
1440 Review ' 
Conventional 



ERLC 



13.32 
13.51 
13.53 



23.65 
22.53 
21.87 



60.62 
58.57 
57.27 



The results indicate that although , tftfere was no significant 
difference in the teat performance o| the CAI group in 
comparison to either a conventional lecture group or a 
group which also reviewed on the 144<r, there was a learning 
time savings of -approximately twelve percent. 

3i2 
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(3) The post-course interview data reflected a generally ^ 
positive attitude on the part of the students. 
Course^organization was highly satisfactory and none of 
the course concepts were judged to be unduly difficult 
About half the st^6nts preferred the 1500 CRT system, 
27 percent preferred the 1440 typewriter system, and 
23 percent had no preference. 

Majer, Kenneth S. A Study of Computer Assisted Multi-Media Instruction 
Augmented by Recitation Sessions . Institute of Human Learning, Florida State 
Universit)^, Tallahffssee, Florida, 1967. 

College Physics 107 

Twenty-two (22) Ss taking the CAl/Media course supplemented 
by recitation, and a control group of 225 volunteers from 
the/traditional physics* lecture course. The latter, were 
paid volunteers who agreed to take the examination and 
complete the questionnaires^ for ohe dollar per hour. (Ss 
-may not have been representative of the population from 
which they were chosen,) 



Subject Content: 
Subjects: 



Ten week. Twenty of the twenty-nine lessons included a 
PSSC film with running time of 20 to 30 minutes each-. 

Twelfth grade physics examinations, physics pretesjt, 
scales from the College Student Questionnaire, Physics 
107 final exams. ' ^ 

Problem: (1) To investigate the relative effectivene^ of^th^ CAl/Media 

course when compared with the traditional lecture courlse. 
(2) To determine who are the greatest beneficiaries of the 
CAl/Media course, the bright or not-so-brigh't students 
(as measured by the phyaics pretext). 

Procedure : CAI physics course followed the same general outline 

of the companion course taught by lecture. The CAI 
students were allowed to schedule their own time at the 
CAI center. At the center their program was' paced by the 
^ computer terminal. The computer terminal functions pri- 
marily as a pacing, quizzing and record -keeping system. 
This terminal consirsted of a cathode ray tube (CRT), a 

\ ^ television- type screen, with* a ^fypewriter keyboard. , 

Problems and instructions to the student were displayed 
on the CRT. The student could indicate his response to 
the computer by typing or touching a special light pen to 
the appropriate portion of the CRT. 

The usual pattern of the course involved the student^s 
first reporting to the computer terminal and taking a short 
quiz over the reading assignment. If the student did not 



Treatment Period: 
Criterion Tests: 
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pass the quiz, he was instructed to reread the material 

and return to take the quiz again. If successful, the 

student was directed to listen .to a short audio lecture 

, ' . on .the topic being considered. A special cartridge system 

piped the audio lecture to the students at their terminal. 

Also, the student was provided an 'outline which included 

helpful drawings relevant to the lecture> Completing the 

lecture, the student would return to the terminal for a 

quiz on the audio presentation. The student would then 

-^e directed to a single concept film loop or a PSSC film. 

The single concept film loop presented demonstrations of 

some, of the major concepts included in the lesson. Outlines 

alsd were available for the film lo^ps. If the student 

was directed to view a PSSC film, jie advised a proctor 

who ran;.the fibn. The student returned to take a short 

quiz on the film. Depending on the lesson, the student 

might be directed to other presentations on various media. 

At the completion of the entire sequence of instruction, 

the student was given his next textbook assignment-. Both 

treatments received the same- reading assignments in 

Elem e ntart'^ Physics . 

t 

Most students averaged about two lessons per visit to the 
CAI center ^u^ ranged from less than one to elever^ lessons. 
^-^^ The only constraint placed on the students in regar^d to 

time was that they ^rusf reach 'the half-way point by midterm 
.ted ^nd the course by final time., ' ' n 

\ 

Results: (1) Ss in the CAl/Media course perforimed as well as the ^s 

instructed by conventibnal lectur^es when the depende^it 
measure is the traditioaal lecture-based final exSBu 
(2) Brighter Ss achieved to a greater degree than did the 
not-so-bright Ss. 

Morrison, H. W. and E. N. Adams. "Pilot Study of a CAI Laboratory in 
German" Modern Language Journal . 1968, 52, 279-287. ' ^ 

'Subject Content: College-Level German. 

Subjects: Twenty-five (25) students received instruction via the 

aurfio-lLngual method (ALM) . 

Treatment Period: Students in the CAI section meth their instructor for 

three 50-minute class periods each week. Students in 
the ALH section had three class meetings and two 25- 
minute conventional language laboratory periods 
scheduled each week an^^ used a text designed for ALM 
instruction. 

Problem: " Jhe students in the CAI and AUi sections were compared in 

V * terms of language aptitude, overall academic achievement, 

course grades, tests- of German achievement at the end 
of the course, a'nd student opinion of the twa kinds of 
laboratories . - — ^ 
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The CAI section was taught via the direct methQd in- 
cluding audio-lingual pattern drills. There was no 
written homework and practically no class time was 
spent on writing, translation, spelling, vocabulary* 
or reading. Recitation which emphasized facility 
in writ-^ng German was scheduled for two 50-minute 
periods each weel^ at a CAI instructional station. 
Students could 'schedule additional time if terminals 
were availabl.e. 

In the CAI laboratory each student proceeded at his 
own pace, working on one unit of instruction at a 
time and going on to the next unit only after 
satisfactory proficiency had been demonstrated. 
Students were encouraged by their , instructor to com- 
plete the exercises and to maintain progress if 
they fell behind, "but fehey'were not required to dp 
any CAI work and they were told that performance 
scores from the tIAI esercises would not be used in 
\ determining their course grades. 

Audio-lingual method (ALM). For purposes "of comparison, 
data were collected from a second introductory German 
section in which the same instructor. Professor Ruplin, 
taught by the audio-lingual metho4 (ALM) i^sed in^all 
other sections at Stony Brook, This ALM section had 
three class meetings and two 25-minute conventional 
language laboratory periods scheduled each week, and 
used a text designed for ALM instruction. It was 
intended at the beginning of the year to compare final 
achievement of students in the two original sections. 
For this reason students were assigned to both sections 
through the normal registration procedure, which is 
effectively random. 

CAI laboratory vs. conventional language laboratory-- 
other important differences were: textbooks (hence 
V linguistic content), method of classroom instruction, 
examinations (different, because^ texts and methods were 
different), and possible effects-of novelty on 
motivation. In addition, because of the turnover in 
the ALM section noted above, in effect, pre-testing 
was done on one ALM section, post-testing on a 
different one. 

TaHen together, results suggest that the students in the 
CAI section: 

(1) were comparable to those of the ALM sections in language 
aptitude and general academic achievement; . 

(2) without using the conventional language laboratory acqui 
the skills of speaking and listening about as well as 
ALM students ; 
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(3) without specific classroom instruction in reading and 
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Table 1 














- First Semester 


Grades 




i 
























W/I 


F 


D 


" G - 


B . * 


A 




Stony Brook Alid students 
outside study 


12% 


107, 


127, 


257, 


28% 


137, 


(Njt226)' 


First-Semester Alid section 


4% 


227, 


137, 


307,^ 


11% 


9% 


i 

(«=23) 


Second-Semester AI2i section 






'67, 


•297, 


.35% 


297, 


(N=17) 


First-Semester ALM students 
who registered for second 
semester /f 






77, 


437, 


36% 


147, 


(N=14) 


CAI section 


47o 


07, 


87, 


387, 


35% 


157," 


<N=26) 




, Table 


lb 
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Second Semester Grades^ 










■ 


- W/I 


F 


D 


C 


B 


A. 


> 

1 


ALM students outside study 


147, 


37, 


87, 


317, 


26% 


187, 


(N=163) 


Second -Semester ALM section 


67, 


07, 


247, 




24% . 


1 0*7 


(N=17) 


First-semester ALM students 
who registered for second 
semester ^ 


147, 


77, 


147, 


36% 


21% 


77. 


(N=14) 


CAI students \rfio registered 
in CAI second semester 


177, 


07, 


177, 


33% 


. 21"% 


12% 


(N-24) 



In sUnmary. the above comparions indicate that within 
sampling errors in the data: 
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(1) The CAI and first semester ALM students are com- 
, *• ' parable on both GPA and language aptitud^e. 

(2) The second -semester ALM stiidents are comparable ^ 
to or slightly superior to the CAI students on 

the basis of GPA, and to first semester ALM students 
on the /basis oE. German grades. 

Results: Significant differ^ences were found to exist: 

(1) On speaking > both the CAI group and the ALM' group 
were higher-'than the test standerization group. , 

(2) On writing, the CAI group was higher than both the 
AI2^ group and the standardization group. 

(3) On reading ^ the ALM group was lower^ than the standard- 
ization group (p, •06)., • 

Schurdak, John J. ^'An Approach to the Use of Computers in the»In- 
structional Process and An Evaluation" Americati Educational Researcji 
Journal . 1967, 4, 59-73. 



Subject Content: 
Subjects: ~ , 



Treatment Period: 



Criterion Measures: 



A pcJrtion of a computer course in Fortran. 

The students ^ere 48 graduate and undergraduate students 
in the sumner session At Columbia University. Some of 
the students were enrolled f or ^ voluntary course 'in 
FORTRAN to be taught by Columbia staff. Other subjects 
wer^ paid a fixed sum for con^leting tHe^ experimental 
material, Stiidents were assigned to the three gx- 
perimentatl treatments on a/random basis within each 
classification (paid-not paid, graduate-undergraduate 
etc*,). Of the sixteen students in each treatment 
eleven were paid and five were not paid. The computer * 
and conventional text ^treatments contained eight under- 
graduates, six university -graduates, and two Teachers 
College graduate students. None o/f the students had 
any prior knowledge of any computer programming language, 
^s a group these were able, well-motivated subjects. 

All students worked ^independently. Since only we'' 
computer-controlled typewriters wfere avialable, students 
were run in groups of two for all treatments. Students 
in the three treatments started in their learning task 
at the same time on the first day of each week. All 
subjects worke^^ in two-hour sessions, beginning at the 
same time on successive days, until they had completed 
the course, 

Henmon-Nelson Tests of Mental Ability, College Level, 
Form A, Comprehensive Examinations, 



Problem: 



CI) To investigate the relative effectiveness of three methods 
of presenting instructional content, i.e., CAI, programmed 
text, and a "workbook" approach, ^ , 
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(2) To measure the amount of time required by students to 

proceed through their respective instructional materials. 

Procedure: . Three experimental groups were established to learn a 

» portion of a FORTRAN course by three treatments — by 
computer, by programmed text, and by conventional text. 
In the first treatment students wer^ required to take 
the FORTRAN course. With 'the exception of the McCraken 
(1961) textbook, all course materials and the course 
logic were stored in the memory of a computer. Students 
communicated with the computer system through^ domputer- 
controlled ^typewriters , receiving instruction and entering 
responses through th'ese typewriters, 

Ip the second ' treatment the students learned the same 
%s concepts by us/ng the programmed text written by Plumb 

. ' ^ » (1963). The subjects were instructed to answer the 

.questions following the fran\^s on a separate answer 
shefet, before noting the correct answer on the following 
page, and to work the small dumber dril^l exercises 
and the r^elevant questions on an "examination provided 
in the text. The answers to these questions were also 
provided on a following page. 

In the third treatment ' the subjects studied the .identical . 
I concepts in what, may be described as a "workbook" approach. 

They were required to read a chapter in McCracken's 
(1961) text until they felt they understood the material, 
then to work the problem^ at the end of .the chapter. 
They were instructed to put their responses to these 
problems on separate answer sheets before looking at an 
augmented list of correct answers contained in the back 
of the book, ' 

Results: (1) The CAI group scored ele'^en percentage points, over one , 

standard deviation, higher than the programmed text 
group, which in turn performed approximately six per- 
centage points higher than the textbook group, 
(2) The differences in times to complete leaxning of the 
Fortran materials are not reliable. * 

Discussiofi: The computer-taught students received a large step pre- 

sentation, followed by questions and by immediate effective 
correction proced&res. They did significantly 'better' than 
those who received either a large or a small step pre- 
sentation, followed by questions and simple immediate 
knowledge of the correct results. This suggests that for 
the learning of this type of material it is the effective 
correction procedure, rather than theinitial step size 
or simple immediate feedback that is crucial. 
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The cqmputex can apparently successfully perform at 
/ least partially some of the instructional functions. 

It can perform the functioa of presenting new material 
by providing a controlled presentation of subject 
matter* It can perform a testing fanction by con- 
' * tinually examining the stud^ent concerning his com- 

prehension- of the^aterial just studied. Vt can perform 
a guidance function, by analyzing such test results - 
and then making decisions conqf'erning futur^e pre- 
sentations to the student. It can perform a remedial 
function by identifying the areas of need for such 
special attention, and presenting the student with 
drill "problems and appropriate small step learning 
materials. All of these functions may be performed 
on an individual basis for each student. 

Schwartz, H. A. anH R. J. Haskell, Stu^y of Computer Assisted 

Instruction in Industrial Training. Journal of Applied Psychology . 1966, 
50, 360-363. 



Subject Content: 
Students : 



Treatment .Period: 



Criterion Tests: 



Problem: 



Fundamentals of Data Processing * 

One hundred four newly hired electronic technicjues**** ^ 
all were graduatejp of a civilian or an Armed Forces 
technical program. Seventy-nine technicians received 
training via programmed tests. Twenty-five received 
the same training through a keyboard operated terminal * 
device linked remotely to an. IBM* 1440 computer system. 

Eig^ days (32 actual study^ours) were allowed for 
the completion of the material. 

Pretest on data processing; a final examination; attitude 
questionnaire . 

This study was undertaken to- test the feasibility of 
remote computer-assisted instruction as an industrial 
training technique. 



Procedure : 



^o versions of the course material, a programmed text 
(PI) and a CAT version were employed in the study,. 
Both versions were authored by L.R. O'Neal, IBM, 
Poughkeepsie. The pro^ramm^d, text was primarily linear 
with constructed responses, but also included some' 
multiple-choice responses, and 1)ranch points. The text 
was authored in 1963 an has been used widely within 
IBM.' The CAI version of the' course was designed to 
accomplish the same objective asthe ^programmed text/, 
but included numerous system-cpntrolled branches and' 
skip options. 
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The study was conducted betweerj October 1964 and May 
1965. Upon reporting to work at the IBM Main Plant, ^ 
■Poughkeepsie,, N^York, the stidents, as one of their 
initial assignmerks , were required to complete the 
"Fundamentals of uk^a Proce^ing" course. iThe students 
were divided in€?o tw-^«rtlps. There were 79 students » 
who took the course via programmed texts, the currently 
operational mode of presentation for this course. 

The same course was taken by 25 students via the computer- 
assisted i«nstruction met|J^d.^>^ The limited number of CAI 
terminals available for^fhe study precluded a more even 
division of students to the two groups, 



Results : 



The programmed text sfudent^ studied in a classroom 

under the supervision of a monitor i The CAI students' ^ 

studied in a separate room housing the terpiinals and '-t 

were also monitored. ■ i ^ 

The students studied during the first: four hours oi the 
second shifty During remaining four hours of ,the 
day they attended, conventional lettuye qlasses on un- 
related subjects. Eight days (32 hours) wer^ allowed 
for the completion pf the material. ^ ^ 

Before beginning the cblirse, each student \^as ^iven a 
pretest ito determine his initial level of knowl^^^e of 
data processing. Upon completion of the course, each 
student ^as adminis tered .a*^ final examination t6'. evaluate 
.the level of proficiency at\aine^» Prior to the ad- 
n^inistration of the final examination, each student was 
asked to complete an attitude questionnaire" to determine 
his attitude toward his respective technique of study as 
compareH to a regular classroom procedure, 

^ The achievement scores and course completion times for the 
twc? groups are presented in Table 1, The difference 
bettween 'the two groups (p > .05). Therefore; it may be 
assumed that in terms of knowledge of course-related Hata- 
processing inforraa^tion the groups were equivalent at > ^ 
the outset of the course. ^ ^ v 
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Table 1 

Examination Scores and Completion Times 



A 



TTPM 


' 1 


CAI 




PI 






SD 


M 


SD 


Pretest 


12.3 


13 .-3 ' 


16.8 


13.0 


Final examination ^ 


86.5 


7.7 


86.1 


9.1 


Hours to comp|etion' 


• 22.4 


4.6 


. 25.1 


6.1 



Final examination scores of the two .groups did not differ 
significantly (p y .05). Thus, the tm instructional 
methods appear to be equally 'effective^n accomplishing 
their objectives.^ This outcome is readily understandable, 
ii>asmuph as both *the CAI and the PI presentations were, 
designed, nretested, and revised to meet certain specified 
objectives^ Since these objectives were the same for both 
the courses and since the final examination justifiably 
tested for the accomplishment of these objectives only, 
no real difference in examination scores would be 
expected. In any event, the uncertainty involved* in the, 
intrepretation of most achievement tept scores would 
tend to vitiate the meaTfiingfulness of any differences 
unless quite large. s» 

Tirae, however, is another matter. In the industrial world 
time is rather directly translatabl^e into economic factors 
dnd therefore any saving in time is noteworthy. Table 1 
shows that there was approximately a 10% difference in 
the amont of time required to complete the course, 22.4 
hours for thp CAI groups as compared wfth 25*1 hours for 
the PI technique. This difference was statistically - 
significant (t = 2.35, d£ = 103, p < .05)/ Since th^fe 
course content was essentially- the same, it is likely . 
that this time saving was due to the pretesting ^d 
system-controlled braching features built into the CAI 
presentation, which permitted the CAI .stud^ts to propel 
themselves throjiigh^^ the material more rapidly than the 
PI text^etudents who, , due to the nature of that medium, 
were forced to proceed in a more .uniform sequence. 
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Table 2 presents the results of. the objective portion 
o,f the attitude questionnaire. In this portion the 
student was -presented with^ four questio^is concerning ♦ 
his feeling toward Ms particular tnethod of instruction 
^ ^ ' (CAI or PI>. ^The student indicated his choice by * 

checking the most appropriate of five 'statements follow- 
ing each of the questions. ^According to the statement 
checked, a scale value was assigned^. The value ranged 
from 1 (indicating negative feelings- toward his own 
. method) through 5 (indiqating positive feelings toward 
his»own method). " ^ ^ 

It may be seen in Table 2 that both groups of students 
considered their respective methods of instruction as 
*^ approximately equal to the classroom in both effectiveness 

and desirability. The Median test revealed no significant 
difference between the two groups for any of the fouf 
q^B[ionnaire Items. 



Table 1 

Mean Scale Values On Attitude Questionnaire Items 





Questionnaire Item 




CAI 


PI 


In your opinion^ how well were you taught 
the material covered? 




3.0 




In your opinion, how difficult is it to 
learn through CAl/PI stuS^^ 




3.1 


\"'' 

\ 3.0 


Whith method of teaching do you like best? 




2.8 


3.0 


If you had your choice, which method would 
you use in future; courses? 




3.1 


»> 

3.0 



Thus, form,,the Standpoints of educational effectiveness 
and .student acceptance, the results of thp study in- 
dicate the feasibility of computer-assiisted instruction 
as a means of industrial training. 



Schwartz, -H. A. and H. S. Long "A Study of Remote Industrial Training 
Via Computer-Assisted Instruction" Journal of Applied Psychology . 1967, 
.51, No. 1, 10-16. ' . ' 

Subject Content: Computer Technolog]^: Fundamentals of Data Processing. 

Subjects:^ Forty field engineers participated in the study as students*. 

Twenty-four were assigned to the CAI treatment, sixteen to 
' the self-study programmed ^test format. x 

Treatment Period: $xsj months, CAI -students were ordinarily scheduled for 

study sessions of two hours duration, five days per week. 

' ' * I^n some cases, however. Impending date's for education- » 

o^enter classes forced more extensive study periods . 

Self-study students were less formally scheduled and 
^ supervised but were ^couraged to spend at least two 

hours of each working day in study. 

Criterion Measures: Achievement . , The achievement measures consited of th"e 

scores attained on Parts II and IIJ of an independently 
prepared, four-part final examination (P^arts I^and IV 
were not related to the study course material). The 
examination was multipl^e^-choice in format and was 
administered to the students by the monitor. Part II 
ct^nsisted of twenty-five questions and Tart III of ten. 
Eaph part was scored independently on a 100-point scale. 



Time. Monitors maintained continuous records of on-job 
. * study time 'for the CAI students. Any off- job time is 
spent in study (e.g., reading reference manuaJLs) was 
reported on a questionnaire completed by the CAI students. 
The self-study students were supplied with a special 
fgprm, on which they made dialy recordings of their on- 
job and off-job study -time and which was returned .to the- 
monitor. 

Attitude. At the end of ' the course, but prior to the final 
examination, each student completed an attitujde questionnaire, 
^his questionnaire solicited his comments on both the 
^/ ' ^ourse material .and the instructional method' and also 

^ require^ him to compare his instructional method with 
^ther techniques. 

Problem: ^ Examination scores, course completion time, and attitucies 

of the students in\the CAI group were compared with those 
of the students who received the content through self- 
study texts. 
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Procedure: ' ' CAI system t The CAi system employed in the study was an 

IBM 1440-14'48 system. The student terminals were of two 
types: one type consisted of a typewriter-like device on 
which the student, could receive typewritten messages 
^ * from the computer and could type his own messages to the 

computer. Visual material portions of the Course text 
were contained in a* separate book to which the student 
was referred, when necessary, by a typewritten message. 

^ ' The- other type of terminal consisted of both the 

typewriter-like device and an associated stored-image 

^ visual display device. The required visual and textual 
material was presented to the student under the con<^rol, 
of the central computer. With both display'and non- - 
display terminals, the student responded to the system 
only via the terminal keyboard. 

In keeping with its original intent--that of determining 
the feasibility of CAI as a means of -accomplishing the 
' * required training without removing the student from his 

work loaation--the study was conducted under generally 
normal working conditions. In each location a monitor' 
. was designated to be responsible for operation of the 
terrminal, the registration of students, maintenance of 
, records, collection of data, and the establishment of 

study schedules. 

As part of their normal educational sequence, students 
" _ were assigned by) their managers to complete the. pre- 
school course.* Although a ntimber of students might be 
taking the course at any given time, the original 
assigntoents were generally made on a one-at-a-time basis. 
» When the assignment to the course had been made, the 

, , student waa then further assigned to either the CAI or 

self^study technique of instruction' by the study monitor* 
in the assignment and atten5)t was made to fully utilize 
* the CAI terminal in each location. Thus, for each 

~ ^ 'r ' Student an attempt was first made to assign , him to CAI. 

. ^ Where the terminal was not available at the time required 

by the student's schedule, he was assigned to the self- , 
^ study group. 

Results: (1} CAI students scored lower on one part of the examination, 

' . * but completed the course in considerably less time than 
5 th^ self-study students. > 

(2) Attitude scores were somewhat equivocal. Students^ who 
had been exposed t6 both CAI and self-study text 
indicated a strong preference for the fc^nner. 

Smith, Authella Report of the Evaluation of Mathematical Preskills # 
The Labqratory for Computer-Assisted Instruction, The University of Texas 
at Austin, 1970. 
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Subject Content: \ 
Subjects : 



Treatment Period: 
Criterion Test: 
Problem: 

Procedure: 
Results : 



Subject Content : 

Subjects : 

* • * • 

Treatment Period: 

Criterion Tests : 

Problem: 

Procedure : 



College Level Math (Exponentiation) 
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Two hundred fourteen students were paired and the pairs 
performed at the terminal at the same time. Data re- 
ported based on pre- and post-test performance of 132 
students'. ^ 

Ninety minutes--average . 

Pre- and post-tests on^the subject material* 

To measure students* achievement af content^ presented 
.via CAI. 

Pairs of students at the terminal -as the same time. 

Individuals with very low initial scores improved con- 
siderably. As the test only had twenty-five items, 
those individuals with very high initial scores had no 
room for improvement, but in general, there is a marked 
tendency for gain to be negatively associated with 
initial -'performance (linear correlation-- .59) . The 
author claims that individuals who are diagnosed as 
being seriously deficient can expect to improve their 
performance consideably at least on a percentage basis/ 

* ^ * 

'College Level Math (Exponentiation). 
Ninety-eight Engineering Freshmen, 

Seventy-eight minutes--terniinal time. v 

Pre- and post-tests on the subject material. 

To measure students* achievement of content material. 

The timing information was obtained from each student's 
user file which is maintained on disk. 

It is supposed to reflect the total amount of terminal' 
time. Due to a system problem, however, so8:ie of the 
times 'carried in the users file were apparently inaccura'te. 
Every student response is written on tape with an in- 
dication of latency time. The latency times^were 
accumulated for each student and the latency times were 
compared with the times from the user file. In order to 
obtain some measure of pre-post test performance without 
disrupting class activity, certain of the diagnostic 
test items were defined as pretest items and a parallel 
set of items were programmed for administration. after 
instruction in each segment. If a student's diagnostic 
test performance indicated\that h^ did not need instruction, 
his pretest* score was arbitrarily 'assigned as the post 
test score, 

45' . 
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Results indicated that post test means were uniformly 
higher than pretest means,. but only by a small amount. 
Pretest performance was so high that little room was 
available for improved performance. Either freshmen 
engineers are generally not deficient in this area of 
mathematics (i.e., exponentiation), or" the test items 
were much too easy. 

As the diagnostic test (and thus the pretest) was pre- 
sented just before each segment, a part of the performance 
,of thos*e students who took all four segments can be at- 
tributed to the fact that four the later segments, they 
may have received instruction o;^ the earlier segments. 

The number 6f students making a perfect score (34) doubled 
(70) from pre-, to post-test, but the one student who ^ 
appeared to have difficulty raised his score by only 
two points (9 to 11). This student spent 58 minutes at . 
the terminal. As a comparison, the student who raised 
his score from 14 to 19 spent over , three hours at the 
terminal. The course is programmed so that a student 
may ski^ an item if he wishes. A student who demonstrated 
deficient performance along with minimal terminal time 
has usually just skipped items, reflecting (probably) >a^ 
lack of motivation. The students in this study were 
required to take Preskills, but they were not graded on 
the quality of their performance. 
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